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(57) mm 

h7^^5K— b^MJ— A (TS) ^V^ofcAylS^^— 
TSSrDCT-RlgtS-C^a— KUT, DCT«I 

75iMPEG2f=-y6t©it, ®^S^LSit> 
ii*H*7&SttT, SfSfif© I Dlf$&Sr?»j£ 

= tr— ©s&jk, ^s-rs <fc 5 Lfco 
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1 

e> b9^*#— b y — AT?^»3£»bJh/fc»te*fc 

Mft-ffi bfc R§*&£ fcttllfrT = - -RS:23P i: ttffttft 

h y — 2»<Dtf ^ H£«^«>^»e>*bfcif ^ b»a> 
«b&5x-^3r> Wc?—9<DVy h&tm— try b«d> 

b b^ v^^— b* b y — At^fc£»fc;ft*fcMite*fc 
«*aLfcWt6*fcW:l|»T3-KSra£l|ii: ttf*^ 

btitcm^m^v^m^^hy^^- h^ b y-A 

h^by-AO^yhfifH, «tf ^ bteffiiff^-tf n 
^^7^ >-^if s> b<otry b»fcj£i^r£*5*:y b 

[»*J3] b^v^^- b* b y-AcD^-^^J^ 
fc^fcfl^a^Ui&sSlfeiiSixfcb^^sK— b^ b y 

b* b y — Acotr-/ btfoh7y^^-f^ by 

[000 1] 

b y — A (Transport Stream , EJTF. UltT S fcfB 

Z>tc*b<D$im (BT. lDflMii:Ei-) fc«^ttfcW»i 
-r^m^f-a^b (Watermark i: 5) # 4? 

MPEG2«WcWLfcWWb <£TT\ MPEG 
2^-^fcilEl-) f*— I DflMSSr^a^bi tt 

sfc»tr«^aa>bs«>&*s«, ^^s&a^tut 

[0 0 0 2] 

5o ^^a^a^btCjzoT. f-^OTIE^t^W 50 
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bi: b-ca»5itpri!^fett5o ^jE^tr— # 

bfcd*Sr»*rSwi:*-C*S±5fc. S« 
SSUfcHi-S I DflMSrW^a^bi bT«*iitf^k 

[0 0 0 3] Si\ ^fsfflU-CH^x-^ fc: I Dlf#£® 

^aa>bi: bTS&atffcftictt, awi-aiittiT*— ^ 
tat bT * e> d» c fcm^a** b a, t**5 < ^& 
fc* EjBw-i^fcoasfcjsv^Tm^a^b^aifeatf* 
«fek*fc«. Hlr#o*tt-e«^aA>bSr«*iitf*ftk 

^m^S^bSrS^tf^t, 1B*fc:*I'bDCT(Dis 
crete Cosine Transform) -fUy bgE3&& 

^©*SI*Wo fca^WftltSrSiLTW^a^bSra* 
Si*. aflMHHrv\ ^*tLTl^lM*^i 

T*gfSbfcH^^— ^t-^fbTST-a^bSra^ati 1 ^ 

^^assfeatp^A-^Bsii^bDCTaEift. 

^Afco^TB:* B»^V;J> bn-^^1997^ 2^240 
^-cofB* IT ra^-a^bj ^^/^^7*>frK i ftSr i * 

[0 0 0 4] ft^^Jfe-em^a^bSrafeatf^jSJ: 
Uttt, MP EG 2ff^fbf-^MOfc»©ff*ft«> 
aglS^C^oV^-C. PI*f-»bDCTSlfcS:fi 1 ofc««>fil»: 

mc^^-cw^Ka^bfcafea*. ^if^^ 
*r-w\ Rr**WH*ffc. *aft«rtxo-c-. Ts*^j«i- 

S^ffi^^dv MPEG2fffftr- ^£DHj#-<^ b/V 

©ttss^rw^ad^bSrafeatp^ffi^ifdsfcSo 

[0 0 0 5] «±l^^bfcJ: 5t-. t^b^lfcii 
^ttM^—^K^bTS^atft^ aB««»lc3s}-b 

G-frhZo -tr-e. TStc^fb-c i D«^^a^-a^b 
i braa{)atf*ffi3S s Bl»^Fi^"cv^5 0 TS(c*fb-cs 

^a^bSrSfe&tefrffifcbTf*. TSSriB^x— ^t- 

^3— Kb, ^co^ri-K^^fca^-^^brE 

S«-?aa>b S^V^-KbTTStcM 
TSSrDCTWSi-C^s— KbT, DCT 
flRftttSraE^TW^-ad^bSrSlftaA/^, Wt/^>^ 
- KLTTS^It^^^^o r^^0 5t>. TS 

SrDCTfii**^^— Kb-caabatf*a;tt, 

(Frank Hartung, Bemd Girod, "DIGITAL WATERMARKING 
OF MPEG-2 CODED VIDEO IN THE BITSTREAM DOMAIN" ; 
ICASSP 97 PROCEEDINGS April 21-24, 1997 meftStb 
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[00 0 6] 

^Sl^bt LTffl*3itfw i^5«c*4 0 MPEG 2 
ft LfcSmS® :i#tf* 

SrDCTffftitffa-KLt, pCT«M«tt 

V?«a>bSra«>jiA/*:«, Wxy^-FttTSC 

s-r:#5&a s *>s<, r^?>co^-em^s^bSrTS(ca 

[0 0 0 8] *»MG>B«JH\ -b»bfc«««ri!P*i-^< 

<«***j«©sfflr«iifcns-r5fc»fc, ts^ 

-Kt5Iift<, TSKii£SWfc«^8a>b£a&52: *0 
tr#a*:A;t;fc* 1^ LSfe^^f ^ J: 1^1^ S 

[0 0 0 9] 

■[«HSrai8fci-6fc«><6#a] J:1EB 
fc, **MK±5«^ad»La»a*3611fcS8VNrtt:. 
TSOf^S^5ri:^<, TS ITS' h^rjco— 
«rSB*.5ri:KJ:9, S«««<D I Dtim£*F»a»b 

tins *ca»&A/-evN5 0 

[0 0 10] -r&to*>, **i?lci:^f^S^La^ 
- K£S2g£ LT^»je»6>;h,fc«^3&»b&a*i&tf 
©try UfcirRI-ir* b*3S*6>*5a^LW«Jc1Mli- 

[0011] *»wicJ:am^a»La*&*» 
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LrTfcjefefeHfcW^ai^bSraiftatf 

b^hy— A^ify htt«*w*i-s#a, *5 

ITS' h#«E«<0-£nj*^5/:7>f ^#y?y Y<oyfy 
ScSrfflrlBjf Abfc»a»UMW>if * b««»t«TS#a 

[0012] ^wtcisw^ad^baasui 

tt* h^>-^— h y — Aco-r— Yy^^ 

KSrtftttIi-S#a, K*fflbfcWj**fcttj|»T=«— 
S3P4: bTT^^^^^fcffi^S^b^a^a^ttfc b 
^v^zK-h* h y-AOlf y hffi«Srffl*i-5^a. 

b y — acd^— ^yij3&>£>, ^#>^#>?>*l 
fctfy hftdi&feST*— ^Sr»d»b««i:braaji-S 

[0 0 13] 

k ± 5 «^38^ ti»a*«» <t t^m^s^- b« 

MPEG2Mftf^, TSr- ^?U(- 

i£Sffi^3^b^a£>5£tf 5 bXV^^fc^. «T© 

[0 0 14] T Sx-^?iJt-B^@^bSra^^ 

[0 0 15] ^fc. ^M^iS^lcO^-Y^OW-^ 
^Llfeii*81H^ MPEG2(DTS(C53V^, 

^ft-^rixfclB— if y b*^feftsad»b««lc1lifti-5 

r.^:^cJ:o-C«-7■a^bSra»i&A/■T?v^5 0 ^©Sti 1 

laoTMPE G 2 y^K^BJnteSr^ D*VNa 

[0016] ^^c. *&m^£z>m2<D9^7 , <Dn*m 
d»ba»a*ai««. mpeg2<dts^v^, 

bW^^ffA-f*^ rtiao t«^s^ b£a#>&tf t 
ttfc, «^ad»b©a«>a*^i5«F-^t:if ^ h<om 

^i-^c^-effi^b. m^s^b^a^^A/fc^-c^ 
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5 

Tscotf y hWt<Dim\frmt\,?£^£ 5 dbrv^ 0 if 
[0017] ;^wfci5«^»a*bs»&*fc 

b 0>S » & ^>fr m ^fff fcSUb JWrt^Tj^tO 

[0 0 18] *fc. *»HfcJ:5«^a3»»UttfflK« 
(OtfS^ bffi»3£*te«S:8«e"b;fc k * P3«ld. T 

[0 0 19] ETFfci, J:9*flc»ft*5lKKJ:5«^a 
[0 0 2 0] BIB, MP E G 2 W^flStrJBV^fc^v^ ^ 

/^fomis*T2*<DWcmmm<Dnffi<o9i&&7x* ? ? sue 

T*U *fcEI2M:. MPEG2«F^fcSrfV^fc7 f ^ 
T/^LTV^c glKC^V^T. 1 JIM PEG2xyn- 
*3Vvt\ 4tt£«8L 5Bf^^7^7, 6 liM P E 

[0 0 2 1 ] *i\ 0 l fcS^SHMIfc^T. 3SH51 
<fc 5 fci-*8*»«*V t fc**rflr#A t tt. MPEG 2 
xy3^i(-j;>)MPEG2^k$}xilfTS t 40 

stii *?7>-*77 2iaot^^7 v^/i^aMt^ 

[0 0 2 2] BB2Kl»-rSflSai4tc 
J:*9«^$HTfS-^S S r (^-^ tf y h * h V — A) 

d#oTV^ 0 MPEG2f="-^l MTSrSrM 50 
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e 

PEG2S^tU *<OttJ*ffi!lKI*»fflr#Vr fc*^rfll 

[0 0 2 3] E*±<D*fc3ya«!k Sft#flfl^#K«fc:^? 

S^fctt, S t ifl-fTS r . *fc«-»S S t k 

fff-g-S S r n^ti^tim— <Dh<Dk%:Z>o HT-efi, K 

[00 24] ±|BR«"e. 3J|d*b««SrS«>a*-f fc, 
§flfi(Ci3l^, :7\ K^-f-*^ MOD (M 
agnetic Optical Disc) (OX 5 JfclB«*&«KHB-i§-T S r 

SSf-^S:MPEG2f3- ^fcAAU iWiL ^ 

fftojxfc<o^ftif<D*«) ttlE«S;h/rv^i^;fc», 
IE = ^ if ^ o^fiSIST^tofrfc hco^hZ fr&W 
7£-fZ>^ktemm'?&Z>o 
[0 0 2 5] I3tt, ^P^^i^li^S^Llfe^ 
:y^H»-T*bTV^5 0 13 3 tc^SV^T 
tt, H2 4:13— IRig^^o's/^dttia— W-S-Sr#bT* 

tb*V^«^F3S^bS«>5i*leIK 7 36S, f^^7V^5 5 
WPEG 2f^-^6 tC0K(C^#^tt. f-l-TSr 

wttrcDW^-a^bafta^iiiKroai*^^ b y 

-A£*b. ^tOf*— ^«Jttt«#TS r ^Slb#atlC 
4otV^5 e *fc. fl^Vrw, Arwli t?S^L 
S^jA^tUK 7 ± o -ClfS^ bdsffiae>5i**tfcf3-g- 
TS r w^MPE G 2f^-^6CA^ LTMPEG2 
«*fbbfcBWftW^, W^a^^- ; e^^^ r ^^^bTV^5 0 
[0 0 2 6] JScS»36^e>gfll#«lc3SfenT*fc7*^ 
\s tf i? a vm&tegff^ 4ia ot7^ ^ /^"^ S 
Srdttfl£*U -r^^ 5 tC^b^^o 

7^75m X? yZs-J/isZtltLin-flrS S r ^r^^ 
9^/wS*L«V^3S*0«#TS r Kg*-*-* (r^* 

^■a^bs«>a*igi»7d3si9, iD**sr«-7-ad*b 

4: LTfitT S fcSaoa*, a^^*ttfcfg^-T S r w 
tLTMPEG2f^-^6WIIIf 0 S^-^b^ 

al»a*i^Tv^T l t>', MPEG2f^-^6}at(ci 

[0 0 2 7] £Ui«)#« (13«) diSWC, ^ 
5 tW^Sd^bafeii^lHlK? Sr— fle-fkbT 
1 f@£>m;fg[Hj&& (IC) iKi 19, fS-9-TSr 
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7 %^tib<D\m&Mfrbi§^&&y) &^te^ s iM<o i c 

Ct5:i^ ^© I C^MTS r w$r^— rf^ 

14, i?<oS«««fcJ:5. S^SJxfc^— ^■efc*^*' 

[0 0 2 8] 14ft MPEG2Wfi»^f^^f 

f4, TS (H 1 75^12 3 T?ttu TSt, TSrtlE^tb 
SrifiStSTS^yKi, PID=kcoi# 
Bfcfifc, P I D=nOi*tF©f-^t?*5r tSr^tb 

>f XKxw^ y b y — *it¥ri*u ^^^yp 
ESHK:3lfiR€\ B*<Z>J:5fc:* PID = kOTS^ 

W«a 5 #i^TV^o P I D = n <£> T S s<^r y b 2* 
^tC^COPES^^^tV^)^. EUtCt4^£*VCV> 

[0 0 2 9] B5i4, MPEG2«2g(c£3^#fl:®'& 
if, ^-i/-*:/- tr^*- (KT, GOP^IE 

-^y^ • ^y * k («T, SHCiia-T) . # 

b • = — K («T> GSC^fS-T) . tf 
— • — b * =— K (EIT. P SCfclB-T) & SO 
XTf^y-fx • — b • K (SIT. SSC^IE 
i") tm%ivZ>&3 2 y?y h<o=i— K"CBM&£ivcv^ 

(»T. SECkiEi-y -c»tltv^ 0 r*L£>©gs*& 

*fctt»T = — Ki42 4 tr^y f<Z)g^-F0 0 0 0 0 
1 (HEX) 3— K<D«SSr*i"8 fcT3> b<£>=* — K 

K • ^ • ^ K (E OB) mTLtV^^o 

[0030] B6«u H3 tfow^JSd^usfea^iaB 

T, 8I4TS r #S#gt[US&. 9t45S3glHjK, 1 0 1411 

12 I43§®[h]K, 1 3 tt«»a*#fc3BE*. 1 4 tt 
5SiEia», :teJ:t5l 5ttTS r#Sffcl§IKl?fc5o B6 
lc«-rilIK<Di!i^H:»coJ: 5-e*>5o TSrfif 
*TS r*a^JtIH»8fc«|&Six-CTS r^^y (» SO 
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T, TS rHtffit) . WES r, t^PES r 

SKI Ofcdsv^Ttt, *<D[iia<DA*re*^fc5BMfcP 
ESr^&SHC, GSC, PSC, SSC^<tl5SE 
C36»6>*«W*&**:tt|>T = — K«* (H5#l) 

bii iri^MiHiigi 3^«*&-r^o a*a*«y 

«IhJ3&1 lf4. #il&S*Lfc«*&*fcW:*T = — KW«** 

u *«©*&&*»3aisK 1 3 

^Wt5 0 fc*3, mm\5]&9 t 12, 14fW^ 

[0 0 3 1] H7tt* *»WlcJ:*3S^U«#Ra«>a* 

OD^by— AJ4. 5 iC^Lfc ,1^^LTV^ 
S 0 B6 0IbIB#MK<K Wl»*fcH:JI»T = -K*UiaK 
10i£*5V^T. R*PESrt©iT©SHC, GS 
C, PSC, S SC*5±t5SEC*if<onj**fctt»T 
= — KW*Sr*tHi-5i:. *<D*W»*a»&. PS CO 
<Sfc<DS S Cfitof^ft- Jf 0>*4SO0>.*5>f * 
-Y^A) ©^^-ha-K-efcO, GSC, PSd/c 
i4 S E C <D^M<D S S C ttEffiO tT ^ ^ -Y— ^O*^co 

[0 0 3 2] M^^SiJWlHlS& 1 1 (0 6 #fig) 18 

fc 14^t ^ - k W«*» ^>t 0 ^^^-Jirtossc^ftm 
«flt* (H7#m) «r»««)ai»a*ft!aiiiKi s\zm 

caot^PEs r ©^«>s*e>^fctr y b&e^s 

^3S^L**J?>a*. i^PESrwi:LTffl*t5o 

[0 0 3 3] m6 Sr#flHi-SJC. TS rHilfS^L 
*«*a4hfclftttP E S r w if E S r 14, tth 

S*tfc3BEia» (9, 12^1 
4) te±9*ix^ix©fll#©#-f 5 vy^«Jx.^tt, T 
S r ^fiUHg 1 5 tc^ ibtt^> 0 T S r #S[U^ 15T 
14. TSH^PESrwif^PESr^^IS 

*u w^Sd^udsaftasttfc b?^*— by — 

i^TSr w§rttl^-r^o 
[0034] EI8I4, Bl 6 ^OSIfea^^aiHllS 13© 

14, SKIilKfcH**fctt»T3-K««tt^Sixr 

v^/ c ev^ e B]8^c43V^T. 1 6 ttSfci&^MftlttHS: EU 
HftR^lflLfffl^^S (ROM) , *5<t!518(4S 

[0 0 3 5] S»&*4tt«H*EKl 6(4, ^ 
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r<D^£&oTv^#(2B^3a>bo^masBr 

fg-Cfo^o ROMl 7tt, 5 I DflMSS: 

^i-a^ad^bWftSris^i-So a»a*0K i 8 

«PES r ©tr* M&-«^a^bW«fc«#lfc*:Sni: 

[0 0 3 6] H9tt % H8K*-f-|lI»^J:oT«-?a^ 
biS*»a*^S^n 3>^<D«it«:*bTV^ 0 H 9 ic 

0-7^5/ h^n^^5/7^y^tf^ h (ETF\ ZS 
BilSi") 35S*>5o -W^> ^7>f^oftStt/Mh* 

So 

[0037] r^-g\ afea*w*tf5/ h w^a^ 
as -i- few-g^t*. t"-^^ * 

u a«>a*flMsiry ha* "o w t?*>o ^ 
"o w icemi-^o ti<it asic. a«>»*ttr 

#ify has "i- ^fcofcjfr&icHu a o" i 

u »«>a*w«if y has « 0 W tffcofci^&tcH:. f 

— "1" ittfcj;v\ Iftii***^?' b 

as -i- "eabofcs^^T*— ^Srses*. M o w -e*> 

[0038] BlOfi, 06 fOlfeiiMISK 1 3 
<D»2<0WSr:/n;y:?BfcT*bTV^ o HIOM^ 

t, 19 tt«»&*te«w*iaK, 20fizs B^ani 

2 1fiR*ffll¥ffl^*!) (ROM) . 2 2(^m^F 
aa^Ulf* h£dW3K, 2 3 ttiBEEK. 33*1/2 4 H: 

[0 0 3 9] *fl?ytc*5V^fi, ^ftS»Mxfc4M<z>;* 

#Ai"Sr tt;iJ;9ai&&ti>J;5U:b-T^So 

^eMtHRisK i 9 a0EiiissKiHaifr$ttsax>^ffii 

«f faas^-r®-? sa> b ^a^at? ^ 5 ^ * <o^#>7£& 

felxfcify hffi«*S SCSraBJWcfHRU ®^sa>b 
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fc»oTV^5#tt«^aa»bO*ttj3»priB4:*5. ZS 

B*mia*2 0H:, a»ii*wj»w«**-r«^aia»L 

Kwa-c*s*t5 s s c ta^-sa^b^a^atf^ ^ 

^(D^—Z £ cofglcfcS Z S B, i"*fct>. ^ftfetibh 
titty hfif(Dff©ZSB^PES rd^^ffl 
U *(Dlf * h^C^Z S BCD If y hSMf$&£ bTtttfr*- 
So ROM2 1I1 B 8 1 £ §fsS 

/0 [0040] «^aa*utry h4fedEiai»2 2^, 
— ^wsjbvv m^-Sa^uasa^ii^tv^^^-f ^<dz 
sBotr^ h^cw^^iscr, a^jTaa^bWwsrm^fT* 
a^utr^ hw^aefti-So 3g®[ui&2 312, zsB^tf 
y h«W«KJSCT«^a*ba»a**©7*— 

So ift3i*H*2 4B, a»&*te«W«#3tt[SJ* 
tC#^$ttS^-T 5 BMfcPES r fcfcTbT. « 

^■Sa^Ltry h^J^iiiD^fAL, RSPESrwilT 

ffl^t^o jfAi-iW^aa^utry bWSr it 

^ U H. 2 6 2tt$©DCT«ftr-^/HC#aEt5lf 
2* hMt-f-Sr kin J: 9. r©»Afc± 9^***1,57* 

ttsr <kas-ct So 

[0 0 4 U ai in, hi oK^'tiBim^x^xmi 1 ' 
aa*basa»a*tb5 GianffASixa) -jvyjxDm 

3g«r«L-CV^o Hll^*5V^TIi, H6*©Bl*&*;fc 

«ii»T=— k*whi»i ofcafcii^fywiaai iim 

9^f^ 3 2 If ^ hos s casfc9> ^^-f^ 

<D**fcfi % 5i#, 0 — 7 If y h<DZ S BaSfoSo 

Z SB<Dlf 5/ h&Zmmt Lt, Z S B<Dtf y MRfcjS 

cfetf?/ h»:o®a^b€:a^atPo ffilxtf, zsBaso 

-2 if ^ hO«^tcttJSa»USra«>a*-f, 3^bH 
±CD Z S B aS#^Ei~ Z>W&\zmfr V \ZL V 

fetter*, ^^-f^rtos SCfiriSJp^W-RStuS^ 

»je«>e>*i,fcfit«t-, a»atpjt«ify ha* u o n <nm 

^*Ctt3lfy hOa-K^lO" t "1" O^^C 
tt3 tf^y Y(0^— K "1 1 1 w Sr^AI-So 3 tf ^ h<D 
= — KSr»A-r5ftte9fc, Z S B 4:3 if ^ 

tas-e#So 

[0042] **3 % hi i ^Tjk-fmn. ««tf ^ h (« 
^aa^uwa) as u o w ©i^oife^oif j^t 

rv^So iliDjfA^tufc "110". "Ill" o^ — 
Ktt. MP E G 2g?(^)D C T^tr^^fcSfttS 

^fcSaeSr^-f S-i:tt*v\ KSrifA 
L- ft v t>-&i6T 3 ooftlt: J: 9 b Sra^^tp 

^HTt^c z SBas4 if ^ h<£>#^ict>, ra«jcif 
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hETF0>= l ~-K "1 1 0\ "0110" 

&xxf "our <D4mm-?s r^fe***^*!** 

»iitfrfc*St?*S„ ZSB^5-7t*iyb(DM{)P 
ai-> MP E G 2 JR!P©D C T«ftf-^t#fit5 
Z S B<D\fy b%c£lT<D=L— Ktr/Bv^W^SJ^LSrS 

= log2n i*5o 7h/cU log2n telog 2 n 3rjgx.& 70 

v ©it &m*rh<Dt-tz> 0 

[0 0 4 3] $l± (g&2<Dffl) <OJ:5fctrSftatii 
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Z2 1 

Claims 

1. An electronic watermark embedding device, characterized by 
being equipped with a means that detects a start or end code 
preset by transport stream from a data sequence of a transport 
stream, a means that counts a bit position of the transport 
stream for embedding a preset electronic watermark based on said 
start or end code detected, and a means that substitutes the 
data consisting of a preset number of bits at the bit position 
of the above-mentioned transport stream by the watermark 
information consisting of the same number of bits as the number 
of bits of said data- 

2. An electronic watermark embedding device, characterized by 
being equipped with a means that detects a start or end code 
preset by transport stream from a data sequence, a means that 
counts a bit position of the transport stream for embedding a 
preset electronic watermark based on said start or end code 
detected, and a means that additionally inserts the watermark 
information of the number of bits being determined in accordance 
with the number of zero stuffing bits right after said bit 
position into the bit position of the above-mentioned transport 

1 Numbers in the margin indicate pagination in the foreign 
text . 
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stream and subtracts the number of bits of the above-mentioned 
inserted watermark information from the number of zero stuffing 
bits right after the above-mentioned bit position. 
3. An electronic watermark extracting device, characterized by 
being equipped with a means that detects a start or end code 
preset by transport stream from a data sequence, a means that 
counts a bit position of the transport stream for embedding a 
preset electronic watermark based on said start or end code 
detected, and a means that extracts the data consisting of a 
preset number of bits as a watermark information from the data 
sequence of the transport stream at the bit position of the 
above-mentioned transport stream. 

Detailed explanation of the invention 
[0001] 

(Technical field of the invention) 

The present invention pertains to an electronic watermark 
embedding device that electrically adds an information 
(hereinafter, described as an ID information) for preventing an 
illegal duplication of a digital literary work to a data 
sequence of a transport stream (hereinafter, abbreviated to TS) , 
especially an electronic watermark embedding device that embeds 
an ID information as a watermark into data coded according to 

3 



the MPEG2 standards (hereinafter, described as MPEG binary 
encoding) and an electronic watermark extracting device that 
extracts an embedded watermark. 
[0002] 

(Prior art) 

Recently, in order to protect literary works of multimedia 
data such as images and voices (usually consisting of digital 
data) , the ID information on the copyright has been embedded as 
an electronic watermark into data. In case the data are 
illegally duplicated, the ownership of the copyright of the data 
is clarified by the electronic watermark. In communication and 
broadcasts, in order to protect the copyright of data being 
transmitted, the ID information on the copyright is embedded as 
an electronic watermark at the transmission side. Also, in case 
an illegal duplication is carried out, the ID information on 
receivers is embedded as an electronic watermark at the 
reception side to be able to specify the duplication from a 
certain receiver. 

[0003] First, in embedding the ID information as an electronic 
watermark into image data at the transmission side, there are a 
method that embeds the electronic watermark in advance into the 
image data being transmitted and a method that embeds the 
electronic watermark in a compressing and encoding process. As 

4 



the former method that embeds the electronic watermark, there 
are a method that directly embeds the electronic watermark by 
changing the value of the image data and a method that changes 
the coefficient value after the transform such as DCT (Discrete 
Cosine Transform) and wave rate transform for picture elements, 
embeds the electronic watermark, and inversely transforms it, so 
that the image data into the electronic watermark is embedded 
are generated. On the other hand, in case the electronic 
watermark is embedded into image data received at the reception 
side, the electronic watermark can also be embedded by this 
method. The method that directly embeds the electronic 
watermark into image data and the method that embeds the 
electronic watermark into a coefficient value after the 
transform such as DCT transform and wave rate transform for 
picture elements are described in " ^Electronic Watermark' 
Protects the Multimedia Era" written in Nikkei Electronics, 
February 24, 1997 . 

[0004] As the latter method that embeds the electronic 
watermark, there is a method that changes a coefficient value 
after the DCT transform for picture elements, embeds the 
electronic watermark, and generates the TS by quantization, 
zigzag scanning, length-variable encoding, and multiplexing, in 
the an encoding process for preparing MPEG2 in encoded data, a 
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method that changes a motion vector value of MPEG2 encoded data 
and embeds the electronic watermark, etc. 

[0005] As explained above, the embedment of the electronic 
watermark is any of an embedment into a picture element data, an 
embedment into a transform coefficient, or an embedment in 
combination with compressing and encoding. However, 
distributing and recording are sometimes carried out in a TS 
state in multimedia data. Accordingly, a method that embeds the 
ID information as an electronic watermark into the TS is 
developed. As the method that embeds the electronic watermark 
into the TS, there are a method that decodes the TS into an 
image data, directly embeds the electronic watermark into the 
image data decoded, encodes it, and returns it to the TS and a 
method that decodes the TS up to the DCT coefficient, changes 
the DCT coefficient value, embeds the electronic work, re- 
encodes it, and returns it to the TS . Of these methods, the 
method that decodes and embeds the TS up to the DCT coefficient 
is described in Frank Hartung, Bernd Girod, "Digital 
Watermarking of MPEG-2 Coded Video in the Bitstream Domain": 
ICASSP 97 Proceedings, April 21-24, 1997, for instance. /3 
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[0006] 

(Problems to be solved by the invention) 

In a receiver of a digital broadcast, when broadcast 
programs (contents) are illegally duplicated, it is necessary to 
embed the ID information on receivers as an electronic watermark 
in order to specify the broadcast from a certain receiver. In a 
digital broadcast using an encoding method for preparing MPEG2 
encoded data, data are received by a TS and restored to original 
image data by a decoder. With the embedment of an electronic 
watermark into the image data, when an illegal duplication is 
carried out, the receiver that has received the broadcast can be 
specified. 

[0007] On the other hand, in the reception of a digital 
broadcast, the received TS is output as it is, distributed, and 
recorded. For this reason, in specifying the reception of the 
broadcast from a certain receiver, it is necessary to assemble 
an electronic watermark into the TS by an embedment means. In 
the prior art, in order to embed the electronic watermark, as 
mentioned above, there are a method that once decodes the TS to 
an image data, directly embeds the electronic watermark into the 
image data, re- encodes it, and returns it to the TS and a method 
that decodes the TS up to the DCT coefficient, changes the DCT 
coefficient value, embeds the electronic watermark, re-encodes 
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it, and returns it to the TS . In these methods, a receiver 
equipped with a function for embedding the electronic watermark 
into the TS had to be provided with a decoder and an encoder, so 
that the constitution of the device was made large in scale. 
[0008] In order to solve the above-mentioned problems and to 
realize a receiver with a simple constitution, the purpose of 
the present invention is to provide an electronic watermark 
embedding device, which is equipped with a means for directly 
embedding an electronic watermark into a TS without decoding the 
TS, and an electronic watermark extracting device, 
[0009] 

(Means to solve the problems) 

In order to achieve the above-mentioned purpose, an ID 
information of a receiver is embedded as an electronic watermark 
into a TS by changing part of a TS bit string without changing 
the data length of the TS . 

[0010] In other words, the electronic watermark embedding device 
of the present invention is characterized by being equipped with 
a means that detects a start or end code preset by transport 
stream from a data sequence of a transport stream, a means that 
counts a bit position of the transport stream for embedding a 
preset electronic watermark based on said start or end code 
detected, and a means that substitutes the data consisting of a 
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preset number of bits at the bit position of the above-mentioned 
transport stream by the watermark information consisting of the 
same number of bits as the number of bits of said data. 
[0011] Also, the electronic watermark embedding device of the 
present invention is characterized by being equipped with a 
means that detects a start or end code preset by transport 
stream from a data sequence, a means that counts a bit position 
of the transport stream for embedding a preset electronic 
watermark based on said start or end code detected, and a means 
that additionally inserts the watermark information of the 
number of bits being determined in accordance with the number of 
zero stuffing bits right after said bit position into the bit 
position of the above-mentioned transport stream and subtracts 
the number of bits of the above-mentioned inserted watermark 
information from the number of zero stuffing bits right after 
the above-mentioned bit position. 

[0012] Also, the electronic watermark extracting device is 
characterized by being equipped with a means that detects a 
start or end code preset by transport stream from a data 
sequence, a means that counts a bit position of the transport 
stream for embedding a preset electronic watermark based on said 
start or end code detected, and a means that extracts the data 
consisting of a preset number of bits as a watermark information 

9 



from the data sequence of the transport stream at the bit 
position of the above-mentioned transport stream, 
[0013] 

(Embodiments of the invention) 

Next, referring to the attached figures, the present 
invention is explained in detail based on embodiments of the 
present invention. Since the electronic watermark embedding 
device and the electronic watermark extracting device of the 
present invention directly embed an electronic watermark into 
MPEG2 encoded data, especially a TS data sequence, they have the 
following constitutions. 

[0014] First, in embedding the electronic watermark into the TS 
data sequence, in order to easily determine an embedding 
position of the electronic watermark into the TS data, a preset 
start or end code of 32 bits is detected from the data encoded 
to a TS, and the electronic watermark is embedded into a data 
position preset by counting based on the positions of said 32 
bit codes. 

[0015] Also, in a first type electronic watermark embedding 
device of the present invention, in the TS of MPEG2, the 
electronic watermark is embedded by substituting data consisting 
of a preset number of bits of a preset position by a watermark 
information consisting of the same number of bits. As the 



electronic water embedding device, an embedding position where 
no failure is caused in the operation of the MPEG2 decoder by 
embedding is selected in terms of functions. 

[0016] Also, in a second type electronic watermark embedding 
device of the present invention, in the TS of MPEG2 , an 
electronic watermark is embedded by inserting a watermark 
information consisting of the number of bits being set in 
accordance with the number of bit of zero stuffing bits right 
after a preset TS bit position, and the increment portion of the 
encoded bits due to the embedment of the electronic watermark is 
canceled by erasing the zero stuffing bits by the increment 
portion, so that the total number of bits of the TS is not 
changed, even in case the electronic watermark is embedded. /4 
As the bit string being inserted, a bit string that does not 
cause a failure in the operation of the MPEG2 decoder by 
embedding is selected in terms of functions. 

[0017] Also, as an encoding device for preparing an encoded data 
of MPEG2 to generate a TS suitable for embedding an electronic 
watermark, a device that can optionally move the embedding 
position of the electronic watermark of a receiver by 
controlling the position for a slice splitting during encoding 
is preferable. Thus, the embedding position of the electronic 
watermark cannot be easily understood from a decoded data. 



Also, the electronic watermark of a larger number of bits can be 
embedded by extra "setting the zero stuf f ing bit during encoding", 
[0018] Also, in the electronic watermark extracting device of 
the present invention, similarly to the case where the 
electronic watermark embedding position into the TS data 
sequence is determined in the electronic watermark embedding 
device, a start or end code of 32 bits detected is detected from 
the encoded data sequence of a TS, and the electronic watermark 
embedded into a data position preset by counting based on the 
position of the 32-bit code detected is extracted. 
[0 019] Next, embodiments of the electronic watermark embedding 
device and the electronic watermark extracting device of the 
present invention are explained referring to the figures. The 
present invention can be applied to any system as long as a TS 
data sequence attached with a start code is used, however in the 
embodiments of the present invention, it is assumed that MPEG2 
is used in broadcasting and a digital broadcast is carried out. 
[0020] Figure 1 is a block diagram showing the constitution of a 
facility at a broadcasting station of a digital broadcasting 
system using a MPEG2 encoding. Also, Figure 2 is a block 
diagram showing the constitution of a facility at a receiver of 
the digital broadcasting system using a MPEG2 encoding. In 
Figure 1, 1 is a MPEG2 encoder, 2 is a scrambler, and 3 is a 



transmitter. Also, in Figure 2, 4 is a receiver, 5 is a 
descrambler , and 6 is a MPEG2 decoder. 

[0021] First, at the transmission side shown in Figure 1, a 
video signal Vt and an audio signal At being broadcasted are 
MPEG2-encoded to a signal TSt (transport stream at the 
transmission side) by the MPEG2 encoder 1. The signal Tst is 
changed to a signal SSt by scrambling using the scrambler 2 and 
transmitted to the reception side by the transmitter 3 . 
[0022] The signal transmitted is demodulated to a signal SSr 
(data bit stream) by the receiver 4 shown in Figure 2 and 
descrambled to a signal TSr by the descrambler 5 . The data 
structure of the signal TSr is the same as the structure of the 
signal TSt at the transmission side. The MPEG2 decoder MPEG2- 
decodes the signal TSr and obtains a video signal Vr and an 
audio signal Ar at the output side. 

[0023] In case errors are generated in each facility at the 
broadcasting station side and the receiver side and no error is 
generated during the transmission, the signals TSt and Tsr or 
the signals SSt and SSr are respectively the same. Next, for 
simplicity of explanation, it is assumed that no error is 
generated in each facility and during the transmission. 
[0024] In the above-mentioned facilities, in case no watermark 
information is embedded and the receiver side records the signal 
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TSr in a recording device such as MOD (Magnetic Optical Disc) 
and prepares its duplication, the duplicated data is the same as 
the signal TSt at the transmission side. Therefore, in case the 
duplicated data is input into the MPEG2 decoder and images and 
voices are reconstituted, the same picture quality and tone 
quality as the images and voices broadcasted are obtained. For 
this reason, even if there is a copyright in the broadcasting 
images and voices, they can be easily, illegally duplicated at 
the receiver side, and the information at the receiver side (for 
example, information such as duplication using a certain 
equipment) is not recorded. Thus, it is difficult to specify 
which receiver carries out an illegal duplication. 
[0025] Figure 3 is a block diagram showing the constitution of 
the electronic watermark embedding device of the present 
invention. In Figure 3, the same symbols are given to the 
blocks with the same functions shown in Figure 2, and their 
explanations are omitted. In Figure 3, an electronic watermark 
embedding circuit which is not included in Figure 2 is 
interposed between the descrambler 5 and the MPEG2 decoder 6, a 
signal TSrw shows an output bit stream of the electronic 
watermark embedding circuit 7, and its data structure has the 
same structure as that of the signal TSr. Also, signals Vrw and 
Arw respectively show an video output and an audio output in 
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which the signal TSrw into which the electron watermark is 
embedded by the electronic watermark embedding circuit 7 is 
input into the MPEG2 decoder 6 and MPEG2 -decoded. 
[0026] Digital television radio waves transmitted to the 
receiver from the broadcasting station are demodulated to the 
digital signal SSr by the receiver 4 and sent to the descrambler 
5. The descrambler 5 converts the scrambled signal SSR into the 
ordinary signal TSr which is not scrambled (up to here, the same 
as the case of Figure 2) . The converted signal TSr is sent to 
the electronic watermark embedding circuit 7, and the ID 
information is embedded as an electronic watermark into the 
signal TS and transferred as an embedded signal TSrw to the 
MPEG2 decoder 6. In the electronic watermark embedment, the 
MPEG2 decoder 6 is normally operated, and images and voices can 
be decoded. 

[0027] In the above constitution (constitution of Figure 3) , the 
descrambler 5 and the electronic watermark embedding circuit 7 
are integrated to one integrating circuit (IC), so that the 
signal TSrw (see Figure 3) is a unique data that can be drawn 
out as a digital signal which is not scrambled. Thus, the /5 
descrambler 5 and the electronic watermark embedding circuit 7 
are set as one IC that cannot extract a signal out of these 
circuits, so that in case the output signal TSrw of its IC is 
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recorded on tape, hard disk, MOD, etc., data into which the 
electronic watermark information is embedded into TSr are 
recorded. Therefore, in case the data are illegally duplicated, 
the data received from a certain receiver can be specified. 
[0028] Figure 4 shows part of a constitutional example of a data 
stream of the MPEG2 system. In Figure 4, TS packets 
constituting a TS (in Figures 1-3, described as TSt and TSr) 
respectively show image data when PID = k and voice data when 
PID = n, and each TS packet has a header TSH showing the start 
of these TS . Also, in each TS packet, an image or voice digital 
information is included after a head part TSH. An image PES is 
called a packetized elementary stream of images, and after the 
header PESH, as shown in the figure, a MPEG2 -encoded image 
information included in the TS packet of PID = k is continued. 
From the TS packet of PID = n, needless to say, a voice PES is 
formed, though it is not shown in Figure 4. 
[0002] Figure 5 shows the structure of an encoded image 
information based on the MPEG2 standards. In Figure 5, sequence 
layer, group of picture (hereinafter, described as GOP) , picture 
layer, and slice layer are respectively started by each code of 
32 bits called sequence header code (hereinafter, described as 
SHC) , group start code (hereinafter, described as GSC) , picture 
start code (hereinafter, described to PSC) , and slice start code 
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(hereinafter, described as SSC) . Also, the sequence layer ends 
with a sequence end code (hereinafter, described as SEC) . In 
these start or end codes, codes of 8 bits showing the kind of 
code are continued to a fixed code 000001 (HEX) of 24 bits. In 
this example, with the detection of these codes, up to the 
delimiter of the slice layer is detected, a bit string of a 
preset position being included in the slice layer of a preset 
position is delimited into several bits each, and an electronic 
watermark is embedded into it. Also, a block layer shown in 
Figure 5 ends with an end of block code (EOB) . 
[0030] Figure 6 is a block diagram showing a constitutional 
example of the electronic watermark embedding circuit 7 of 
Figure 3. In Figure 6, 8 is a TSr multiplex separating circuit, 
9 is a delay circuit, 10 is a start or end code detecting 
circuit, 11 is an embedding control circuit, 12 is a delay 
circuit, 13 is an embedding processing circuit, 14 is a delay 
circuit, and 15 is a TSr multiplexing circuit. The operation of 
the circuit shown in Figure 6 is as follows. First, the TSr 
signal is supplied to the TSr multiplex separating circuit 8 and 
separated into TSr header (hereinafter, described as TSrH) , 
video PESr, and audio PESr (see Figure 4) . The start or end 
code detecting circuit 10 detects a start or end code 
information (see Figure 5) consisting of SHC, GSC, PSC, SSC, and 



SEC from the video PESr as an input signal of the circuit and 
supplies the detected start or end code to the embedding control 
circuit 11 and the embedding processing circuit 13 . The 
embedding control circuit 11 generates an embedding control 
information showing a slice (see Figure 5) for embedding a 
watermark information from the started or end code information 
supplied and supplies it to the embedding processing circuit 13 
of the next step. Also, the delay circuits 9, 12, and 14 adjust 
timing. 

[0 031] Figure 7 shows the watermark information embedding timing 
of the present invention. In Figure 7, the signal stream 
showing the uppermost step shows the picture layer shown in 
Figure 5. In the circuit constitution of Figure 6, if all the 
start or end code information such as SHC, GSC, PSC, SSC, and 
SEC of the video PESr are detected in the start or end code 
detecting circuit 10, it is understood from the detected results 
that SSC next to PSC is a start code of the initial slice (slice 
A) of the picture layer, and SSC before GSC, PSC, or SEC is a 
start code of the final slice of the previous picture layer. In 
this manner, the delimiter of the slice can be specified. 

[0032] The embedding control circuit 11 (see Figure 6) counts 
SSC in the picture layer from the start or end code information 
being supplied from the start or end code detecting circuit 10 
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and outputs the embedding control information (see Figure 7) to 
the embedding processing circuit 13 of the next step at a preset 
slice timing. The embedding processing circuit 13 embeds a 
watermark into a preset bit position of the video PESr according 
to the start or end code information and the embedding control 
information being supplied to said circuit and outputs it as a 
video PESrw. 

[0033] In Figure 6, in TSrH and video PESrw and audio PESr into 
which an electronic watermark is embedded, the timing of each 
signal is aligned by the delay circuits (9, 12, and 14) 
interposed in each system and sent to the TSr multiplexing 
circuit 15. The TSr multiplexing circuit 15 multiplexes the 
TSH, video PESrw, and audio PESr and outputs a transport stream 
into which the electron watermark is embedded. 
[0034] Figure 8 is a block diagram showing a first example of 
the embedding processing circuit 13 of Figure 6. Also, in this 
example, the start or end code information is not supplied to 
said circuit. In Figure 8, 16 is an embedding position counting 
circuit, 17 is a read-only memory (ROM) , and 18 is an embedding 
circuit . 

[0035] Here, the embedding position counting circuit 16 counts a 
preset bit position of a slice into which an electronic 
watermark shown by an embedding control information being 



supplied to said circuit is embedded based on SSC and outputs /6 
the embedding position information into which the electronic 
watermark is embedded. As the bit position into which the 
electronic watermark is embedded, a bit position where no 
failure is caused in the operation of the MPEG2 decoder is 
selected. Also, the bit position is a key for detecting the 
electronic watermark, and a person who knows the key can detect 
the electronic watermark. The ROM 17 generates the electronic 
watermark information showing the ID information on a receiver. 
The embedding circuit 18 embeds the electronic watermark into 
the video PESr being supplied to the circuit by substituting the 
bits of the video PESr of the position shown by the embedding 
position information from the embedding position counting 
circuit 16 by the electronic watermark information and outputs 
it as the video PESrw. 

[0036] Figure 9 shows the structure of a block into which an 
electronic watermark is embedded by the circuit shown in Figure 
8. In Figure 9, one of slices into which the electronic 
watermark is embedded based on the embedding control information 
being supplied from the embedding control circuit 11 in Figure 6 
is shown. At the beginning of the slice, there is SSC of 32 
bits, and at the end of the slice, there is a zero stuffing bit 
(hereinafter, described as ZSB) of usually 0-7 bits. The reason 



for this is that the length of the slice must be a byte unit. 
In this example, an electronic watermark consisting of preset 
bits can be embedded into a preset bit position being counted 
based on SSC. 

[0037] In this case, if the embedding information bit 
(electronic watermark information) is "1," a data is set to "1," 
and if the embedding information bit is "0/" the data is 
substituted by "0." On the contrary, if the embedding 
information bit is "1," the data may be set to "0," and if the 
embedding information bit is "0," the data may be set to "1." 
Also, if the embedding information bit is "1," the data is 
inverted, and if the bit is "0," the data remains as it is. The 
selection of one of various data correspondence methods 
including these methods is determined in advance. 
[0038] Figure 10 is a block diagram showing a second example of 
the embedding processing circuit 13 of Figure 6. In Figure 10, 
19 is an embedding position counting circuit, 2 0 is a ZSB 
detecting circuit, 21 is a read-only memory (ROM) , 22 is an 
electronic watermark generating circuit, 23 is a delay circuit, 
and 24 is an embedding circuit. 

[0039] In this example, an electronic watermark is added and 
inserted into a preset bit position of a slice at a preset 
position. The embedding position counting circuit 19 counts a 
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preset bit position of a slice, into which the electronic 
watermark shown by an embedding control information being 
supplied to said circuit is embedded, based on SSC and outputs 
the embedding position information into which the electronic 
watermark is added and inserted- The bit position is a key for 
detecting the electronic watermark, and a person who knows the 
key can detect the electronic watermark. The ZSB detecting 
circuit 20 detects ZSB existing between SSC shown by the start 
code information of the slice positioning next to the slice into 
which the electronic watermark shown by the embedding control 
information is embedded and the slice data into which the 
electronic watermark is embedded, that is, ZSB right after a 
preset bit position from the video PESr and outputs the number 
of bits as a bit number information of ZSB. The ROM 21 
generates an electronic watermark information showing the ID 
information on a receiver similarly to the first example shown 
in Figure 8 . 

[0040] The electronic watermark bit generating circuit 22 
converts the electronic watermark information into an electronic 
watermark bit string in accordance with the bit number 
information of ZSB of the slice into which the electronic 
watermark is embedded, using a conversion table. The delay 
circuit 23 is a circuit that adopts a signal timing for 
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generating data after embedding the electronic watermark in 
accordance with the bit number information of ZSB. The 
embedding circuit 24 adds and inserts an electronic watermark 
bit string into the video PESr at the timing in which the 
embedding position information is supplied to said circuit and 
outputs it as the video PESrw. Here, the electronic watermark 
bit string being inserted is set to a bit string existing in a 
DCT coefficient table recommended by ITU H. 2 62, so that the 
data stream being generated by the insertion does not cause a 
failure in the operation of the decoder. 

[0041] Figure 11 shows the structure of a block into which an 
electronic watermark is embedded (added and inserted) by the 
circuit shown in Figure 10. In Figure 11, one of a slice 
detected by the start or end code detecting circuit 10 and the 
embedding control circuit 11 of Figure 6 is shown. At the 
beginning of the slice, there is SSC of 32 bits, and at the end 
of the slice, there is ZSB of usually 0-7 bits. Assuming the 
number of bit of said ZSB as a limit, the watermark of the 
number of bit in accordance with the number of bit of ZSB is 
embedded. For example, in case ZSB is 0-2 bits, the watermark 
is not embedded, and in case ZSB of 3 bits or more exists, the 
watermark is embedded. In this case, if the information bit 
being embedded into a preset position being counted based on SSC 
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in the slice is "0," a code "110" of 3 bits is inserted, and if 
the information bit is "1," a code "111" of 3 bits is inserted. 
Instead of inserting the code of 3 bits, the entire code length 
is not changed by erasing 3 bits of ZSB. 

[0 042] Also, the example shown in Figure 11 shows an embedded 
state when the information bit (electronic watermark 
information) is "0." The codes "110" and "111" added and 
inserted are codes existing in the DCT coefficient table of the 
MPEG2 standards, and no failure is caused in the decoder by the 
embedment of the watermark information. Also, the watermark can 
be embedded by three states including the case where no code is 
inserted. When ZSB is 4 bits, similarly, codes that can be 
inserted are four kinds of codes "110," "111," "0110," and /7 
"0111" of 4 bits or less existing in the DCT coefficient table 
and can be embedded as the information of 2 bits by respectively 
making them correspond to the embedding information bits "00," 
"01," "10," and "11." When ZSB is 5-7 bits, similarly, the 
electronic watermark can also be embedded using codes of the 
number of bit or less of ZSB existing in the DCT coefficient 
table of the MPEG2 standards. In this case, when the number of 
usable code is n, the maximum number k of bit that can be 
embedded is k = log 2 n. However, log 2 n shows a maximum integer 
that does not exceed log 2 n. 



[0043] The electronic watermark from 1 bit to k bits embedded in 
this manner (second example) usually constitutes one ID 
information by one or several pieces of electronic watermarks, 
however these electronic watermarks are repeated at a preset 
span and embedded into TSr, so that even if part of a dynamic 
image is cut out, it can be countermeasured. 

[0044] Hereto, the electronic watermark embedding device of the 
present invention is explained by two examples in which the 
embedding processing part (the part 13 in Figure 6) of the 
device is different, however the present invention can also be 
used in combination of the embedment of these two kinds of 
electronic watermarks. For example, after embedding the 
electronic watermark by the first example, the electronic 
watermark can also be embedded by the second example. Also, in 
the second example, two or more electronic watermarks can be 
embedded as long as there is a margin in ZSB. 
[0045] In the electronic watermark embedding devices of the 
above-mentioned first example and second example, the electronic 
watermark has been embedded into a preset position of a slice at 
a preset position, however the position where the electronic 
watermark is embedded can also be optionally moved as desired by 
controlling the position being split into slices during the 
MPEG2 encoding. 



[0046] For its implementation, since it is necessary to 
understand the facility at the broadcasting station of the 
digital broadcasting system using the MPEG2 encoding shown in 
Figure 1, especially the MPEG2 encoder 1 (see Figure 1) , it is 
explained below. 

[0047] Figure 12 is a block diagram showing the constitution of 
the MPEG2 encoder 1 of Figure 1. In Figure 12, 25 is a video 
encoder, 26 is a video packetizing circuit, 27 is an audio 
encoder, 28 is an audio packetizing circuit, and 29 is a TS 
multiplexing circuit . 

[0048] In the above-mentioned case, the video encoder 25 
generates a video elementary stream (hereinafter, described as 
video ES) by encoding a video signal Vt . The video packetizing 
circuit 2 6 of the next step adds PESH (see Figure 4) to a video 
ES and generates a video PESt. On the other hand, the video 
decoder 27 generates a video elementary stream (hereinafter, 
described as video ES) by encoding an audio signal At. The 
audio packetizing circuit 28 of the next step adds PESH to an 
audio ES and generates an audio PESt, The TS multiplexing 
circuit 2 9 multiplexes the video PESt and the audio PESt 
supplied to said circuit and obtains a multiplexed signal Tst 
(see Figure 1) . 
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[0049] Figure 13 is a block diagram showing the constitution of 
an example of the video encoder 25 of Figure 12~. In Figure 13, 
30 is a macro block encoder, 31 is a synchronous signal 
separating circuit, 32 is a slice control circuit, 33 is a slice 
header adding circuit, 34 is an ES encoder, 35 is a buffer 
memory, and 36 is a rate control circuit. 

[0050] In the video encoder shown in Figure 13, first, the video 
signal Vt is split into macro blocks in the- macro block encoder 
30, and macro block streams for each macro block are generated 
according to the MPEG2 encoding method. The macro block streams 
are streams in the MB layer shown in Figure 5 . The synchronous 
signal separating circuit 31 separates the synchronous signal 
from the video signal Vt . The synchronous signal from the 
synchronous signal separating circuit 31 is input into the slice 
control circuit 32, and a slice control signal is generated 
according to a preset timing. The slice header adding circuit 
33 collects several macro block streams being supplied from the 
macro block encoder 3 0 at the slice control signal timing, adds 
a slice header to it, and outputs it as a slice stream. 
[0051] The slice stream obtained is a stream in the slice layer 
shown in Figure 5. The ES encoder 34 adds picture header, GOP 
header, sequence header, and SEC to the slice stream and 
generates the video ES with the constitution of Figure 5. The 



buffer memory 35 once stores the video ES and outputs the amount 
of occupied buffer memory as a rate control information. The 
rate control circuit 36 generates a quantization coefficient 
information in accordance with the rate control information from 
the buffer memory 3 5 and feeds it back to the macro block 
encoder 30. 

[0052] Figure 14 is a block diagram showing the constitution of 
an example of the slice header adding circuit 33 of Figure 13. 
In Figure 14, 37 is a slice header generating circuit, 38 is a 
header adding circuit, and 39 is a zero stuffing bit (ZSB) 
adding circuit. 

[0053] The slice header adding circuit 33 (see Figure 13) , as 
mentioned above, collects several macro block streams from the 
macro block encoder 30, adds a slice header, and outputs a slice 
stream. The slice header generating circuit 37 generates a 
slice header bit string according to an encoding method for 
preparing MPEG2 encoded data and supplies it to the header 
adding circuit 38. The header adding circuit 38 adds the slice 
header in front of the macro block stream according to the slice 
control signal being supplied from the slice control circuit 32 
(see Figure 13) and generates a slice bit string. The ZSB 
adding circuit 3 9 adds ZSB to the rear of the slice bit string/8^ 
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according to the slice control signal and outputs a slice 
stream. 

[0054] In order to control the position being split into slices 
during the MPEG2 encoding, in the slice control circuit 32 shown 
in Figure 13, the slice control signal may be output according 
to a preset slice splitting method. 

[0055] Figure 15 shows a slice splitting example in a screen. 
As seen from the figure, a slice in the MPEG2 encoding method 
consists of one or more horizontally arranged macro blocks, and 
its length and start position are free and can be changed for 
each screen. 

[0056] In other words, in the MPEG2 standards, the position 
being split into slices by the encoder for preparing the MPEG2 
encoded data at the transmission side is determined and encoded, 
so that the position where the electronic watermark is embedded 
in the receiver is determined. Thus, the position where the 
electronic watermark is embedded is not easily understood from 
an image data in which TSt (transport stream at the transmission 
side) is decoded unless parameters during the encoding are 
known . 

[0057] Next, in the electronic watermark embedding method of the 
second example, the electronic watermark of the number of bit in 
which the number of bit of ZSB existing at the end of the slice 



is assumed as a limit can be embedded. If a number of ZSB is 
added and inserted in advance by the encoder to increase the 
upper limit of the number of bit of the watermark that can be 
embedded, the electronic watermark with a large number of bit 
can be added and inserted. 

[0058] This is explained below. In the slice header adding 
circuit 33 shown in Figure 13, since the number of bit of the 
slice stream as an output of the circuit must be the number of 
bit at a byte unit, the ZSB adding circuit 3 9 of Figure 14 adds 
ZSB of usually 0-7 bits. In case the number of bit of the 
watermark that can be embedded is increased, ZSB of 8 bits, 16 
bits, or 24 bits is further added by the ZSB adding circuit 39. 
Thus, ZSB has a length of 8-31 bits. Since the code length of 
the DCT coefficient code is 24 bits at maximum according to the 
MPEG2 standards, all the kind of DCT coefficient codes can be 
used as codes of the watermark by adding ZSB of 24 bits. With 
the increase of ZSB, although the encoding efficiency is 
slightly lowered, it has little influence on the picture 
quality . 

[0059] Finally, the electronic watermark extracting device of 
the present invention that extracts the electronic watermark 
from the TS into which the electronic watermark is embedded in 
this manner is explained. Figure 16 is a block diagram showing 



the constitution of an example of the electronic watermark 
extracting device of the present invention. In Figure 16, 40 "is 
a TS multiplex separating circuit, 41 is a start or end code 
detecting circuit, 42 is a detection control circuit, 43 is an 
electronic watermark extracting circuit, and 44 is a delay 
circuit . 

[0060] In the electronic watermark extracting device of the 
present invention, first, a signal TSrw into which an electronic 
watermark is embedded is received by the electronic watermark 
embedding device of the present invention shown in Figure 6 and 
separated into TSH, video PESr, and audio PESrw in the TS 
multiplex separating circuit 40. The electronic watermark is 
embedded into the video PESr (see Figure 6) , and after the video 
PESrw, only the processing of the video PESrw is explained 
below . 

[0061] First, the start or end code detecting circuit 10 detects 
SHC, SEC, GSC, PSC, and SSC from the video PESrw supplied to 
said circuit and outputs these code signals as a start or end 
code information. The detection control circuit 42 of the next 
step generates a detection control information showing a slice, 
into which a preset watermark is embedded, from the start or end 
code information by a method similar to the generation of the 
embedding control information in the embedding control circuit 
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11 shown in Figure 6- The electronic watermark detecting 
circuit 43 detects the electronic watermark embedding position 
from the detection control information obtained by the detection 
control circuit 42 by a method similar to the embedding position 
determination in the embedding position counting circuits in 
Figures 8 and 10 (respectively shown by 16 and 19) , converts the 
bit string of the embedded electronic watermark into an 
electronic watermark information by using the table used in the 
embedding, and outputs it finally. Also, the delay circuit 44 
of Figure 16 adds the timing of two circuit systems of a circuit 
system for generating the detection control information and a 
circuit system of the video PESrw. 
[0062] 

(Effects of the invention) 

According to the present invention, since the ID 
information of a receiver is directly embedded as an electronic 
watermark into a video part by changing part of a TS bit string 
without decoding a TS up to a DCT coefficient, the constitution 
of the device for embedding the electronic watermark is 
simplified. 

[0063] Also, since the electronic watermark embedding means can 
be assembled into a receiver without changing an existing MPEG2 
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decoder, an illegal duplication of a MPEG2 stream is suppressed, 
sot that video data can be protected. 
Brief description of the figures 

Figure 1 is a block diagram showing the constitution of a 
facility at a broadcasting station of a digital broadcasting 
system using a MPEG2 encoding. 

Figure 2 is a block diagram showing the constitution of a 
facility at a receiver of the digital broadcasting system using 
a MPEG2 encoding. 

Figure 3 is a block diagram showing the constitution of the 
electronic watermark embedding device of the present invention. 

Figure 4 shows part of a constitutional example of a data 
stream of the MPEG2 system. 

Figure 5 shows the structure of an encoded image 
information based on the MPEG2 standards. 

Figure 6 is a block diagram showing a constitutional /9 
example of the electronic watermark embedding circuit of Figure 
3 . 

Figure 7 shows the watermark information embedding timing 
of the present invention. 

Figure 8 is a block diagram showing a first example of the 
embedding processing circuit of Figure 6. 
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Figure 9 shows the structure of a block into which an 
electronic watermark is embedded by the circuit shown in Figure 
8 . 

Figure 10 is a block diagram showing a second example of 
the embedding processing circuit of Figure 6 

Figure 11 shows the structure of a block into which an 
electronic watermark is embedded by the circuit shown in Figure 
10 . 

Figure 12 is a block diagram showing the constitution of 
the MPEG2 encoder 1 of Figure 1. 

Figure 13 is a block diagram showing the constitution of an 
example of the video encoder of Figure 12 

Figure 14 is a block diagram showing the constitution of an 
example of the slice header adding circuit of Figure 13 . 

Figure 15 shows a slice splitting example in a screen. 

Figure 16 is a block diagram showing the constitution of an 
example of the electronic watermark extracting device of the 
present invention . 
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Explanation of numerals: 

1 MPEG2 encoder 

2 Scrambler 

3 Transmitter 

4 Receiver 

5 Descrambler 

6 MPEG2 decoder 

7 Electronic watermark embedding circuit 

8 TSr multiplex separating circuit 
9, 12, 14 Delay circuits 

10 Start or end code detecting circuit 

11 Embedding control circuit 

13 Embedding processing circuit 

15 TSr multiplexing circuit 

16 Embedding position counting circuit 

17 Read-only memory (ROM) 

18 Embedding circuit 

19 Embedding position counting circuit 

20 ZSB detecting circuit 

21 Read-only memory (ROM) 

22 Electronic watermark generating circuit 

23 Delay circuit 

24 Embedding circuit 



25 Video encoder 

26 Video packetizing circuit 

2 7 Audio encoder 

28 Audio packetizing circuit 

29 TS multiplexing circuit 

3 0 Macro block encoder 

31 Synchronous signal separating circuit 

32 Slice control circuit 

33 Slice header adding circuit 

34 ES encoder 

35 Buffer memory 

36 Rate control circuit 

37 Slice header generating circuit 

38 Header adding circuit 

39 Zero stuffing bit (ZSB) adding circuit 

40 TS multiplex separating circuit 

41 Start or end code detecting circuit 

42 Detection control circuit 

43 Electronic watermark extracting circuit 

44 Delay circuit 
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1 . Sequence layer 
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1. Video PESr 
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Figure 8 : 
1, Embedding control information 

2 . Embedding position information 

3 . Video PESr 

4. Electronic watermark information 
5 . Video PESrw 
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1 . Slice A 
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Figure 13 : 

1. Quantization coefficient information 

2 . Rate control information 

3 . Macro block stream 

4 . Slice stream 

5. Video ES 

6. Synchronous signal 

7 . Slice control signal 
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1. Preset bit position 
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Figure 10: 

1. Start code information 

2 . Embedding control information 

3. Video PESr 

4. ZSB bit number information 

5. Electronic watermark information 

6. Embedding position information 

7 Electronic watermark bit string 
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Figure 16: 

1. TSr header 

2. Start or end code information 

3 . Detection control information 
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